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IMPLEMENTATION  SCHEME  FOR  RECURSION 
IN  SPECTRAL  DIMENSION 


I.  Introduction 

One  of  major  difficulties  for  thermal  imaging  processing  is  background  suppression.  Many 
different  approaches  have  been  proposed  over  the  past  years  ranging  from  spatial  domain 
cinalysis  to  frequency  domain  analysis.  Recently  consideration  of  coupling  temporal  correla¬ 
tion  with  either  spatial  or  spectral  correlation  is  also  investigated  to  combat  the  degradation 
caused  by  poor  signal  to  noise  ratio  or  low  concentrated  clouds  against  background. 

In  [1,2],  Warren  and  his  colleagues  proposed  a  mixed  approach  to  process  spatial  images 
in  frequency  domain  by  using  a  first  order  autoregressive  time  series  to  account  for  temporal 
correlation.  As  a  result,  Warren  developed  a  recursive  algorithm  for  detectors  to  improve 
detection  performance  of  low  constrast  signal  to  background  clutter  ratio.  Although  Warren 
also  mentioned  a  possible  approach  by  using  a  Kalman  filter,  he  never  discussed  it.  In  this 
report  we  adopt  a  Kalman  filter  approach  to  derive  similar  results  to  that  obtained  by  using 
an  autoregressive  model.  This  approach  is  more  intuitive  than  Warren’s  approach  because 
recursion  is  the  nature  of  a  Kalman  filter. 

It  is  known  that  Kalman  liter  has  a  wide  range  of  various  applications.  The  most  im¬ 
portant  feature  Kalman  filter  possesses  is  recursion  which  can  be  implemented  in  real  time 
processing.  Because  of  its  nature  of  updating  information  as  time  goes  along  it  is  worthwhile 
to  consider  Kalman  filtering  approach  as  opposed  to  Warren’s  approach.  The  main  idea  of 
Kalman  filter  is  to  introduce  a  new  process,  which  is  called  innovation  process,  generated  by 
the  observation  model.  The  great  advantages  of  using  the  innovation  process  is  orthogonality. 
The  principle  of  orthogonality  decorrelates  observations  obtained  from  different  time  frames. 
In  the  case  of  a  Gaussian  process,  the  induced  innovation  process  becomes  an  independent 
process  of  time.  As  a  consequence,  if  a  thermal  image  detection  problem  can  be  transferred 
to  an  equivalent  detection  problem  in  terms  of  innovation  processes,  using  the  independency 
of  the  innovation  process  immediately  will  significantly  reduce  computational  complexity 
and  tremendously  simplify  mathematical  derivations.  This  is  demonstrated  by  comparing 
the  Kalman  filter  approach  to  Warren’s  work.  The  use  of  the  innovation  processes  enables 
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US  to  develop  a  recursive  detection  algorithm.  Since  the  state  and  observation  models  used 
in  Kalman  filters  are  very  general,  the  derived  recursive  algorithm  will  have  more  broader 
applications  than  does  Warren’s  algorithm. 

Both  Warren’s  and  Kalman  filtering  approaches  are  developed  based  on  a  single  spectral 
band.  However,  in  some  practical  cases,  the  target  in  one  spectral  band  will  have  a  large 
contrast  with  high  altitude  clouds  and  no  contrast  with  low  clouds,  while  in  a  second  spectral 
band  the  target  would  have  no  contrast  with  high  clouds  but  a  large  contrast  with  low- 
altitude  clouds.  Therefore,  using  two  spectral  bands  can  ensure  a  good  contrast  for  any 
kind  of  cloud  background.  Because  of  advantages  of  using  multiple  bands  the  extension  of 
these  two  approaches  to  multiple  spectral  bands  is  investigated.  While  it  is  useful  to  process 
multiple  bands,  there  is  an  extra  factor  to  be  considered  which  is  spectral  correlation.  In 
general,  the  dimension  required  for  a  detector  to  use  multiple  bands  will  be  4  times  of  that 
for  a  single  band.  To  avoid  computational  load  for  real  time  processing  two  suboptimal 
models  are  proposed  which  are  characterized  by  separable  spectral  correlation  and  separable 
spectral  Markov  spatial  correlation  respectively.  These  two  model  have  been  used  in  some 
applications  in  adpative  filtering  [3,4]. 

This  report  is  organized  as  follows.  Section  II  reviews  the  signal  model  used  in  thermal 
imaging  processing  and  Section  III  is  devoted  to  the  target  model.  Both  were  developed  by 
Warren  [1,2].  Section  IV  rederives  Warren’s  recursive  detection  algorithm  which  will  serve 
as  a  basis  for  extension  to  multiple  spectral  bands.  Section  V  presents  a  new  approach 
to  developing  a  similar  recursive  algorithm  to  Warren’s  algorithm  by  using  well-knowing 
Kalman  filter  theory.  Section  VI  is  to  extend  results  obtained  in  Sections  IV  and  V  to  multiple 
spectral  bands,  narticularly  emphasizing  two  spectral  bands.  Section  VII  is  a  conclusion 
section  which  suggests  some  directions  for  future  investigation  and  study. 
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II.  Signal  Model 


The  signal  model  to  be  considered  in  this  report  is  suggested  by  Warren  [1].  In  this  section 
we  follow  his  approach  and  describe  the  derivation. 

The  optical  power  collected  on  the  thermal  detector  plane  at  pixel  location  x,  = 
Pdj{'x.i,tk)  can  be  written  as  the  convolution  of  the  entrance  pupil  signal  power  {0,tk)  and 
system  point  spread  function  PSF: 

Pdj{^i,tk)  =  JPa^i9,tk)PSF{Xi/f-e)de^  +  Pr,^{Xi,tk)  (1) 

Here  Pd{^i,  tk)  represents  a  time  series  of  images  labeled  by  index  k  and  multiple  spectral 
bands  labeled  by  index  j  and  is  a  generalization  of  a  single  spectral  filter  and  single  time 
expression: 

PdiXi)  =  J  Pa{0)PSF{x,/f  -  6)de  +  P„(x.) 

where  x,  denotes  the  pixel  location  in  the  detector  plane,  /  is  the  receiver  eff'ective  focal 
length. 

The  PSF  models  the  combined  effects  of  the  thermal  sensor  on  the  spatial  resolution 
of  the  images  which  includes  terms  that  model  the  optical  components  of  the  system,  finite 
detector  size,  and  effects  associated  with  scanning,  electronics,  and  time  response  of  the 
detector.  Although  in  general  the  PSF  depends  upon  spectral  band,  for  well-designed 
systems  operating  in  the  8-12  //m  band  such  as  TICM-II,  the  image  quality  is  relatively 
uniform  with  wavelength.  P„j(x,,  is  additive,  zero-mean  detector  noise  in  spectral  band 
j,  time  k  and  is  uncorellated  with  the  signal.  The  entrance  pupil  signal  power  Psj{9iik) 
labeled  by  line-of-sight  direction  vector  6  is  given  by 

roo 

J  0 

in  terms  of  the  Planck  function  at  temperature  T  and  wavelength  A; 

BaIT)  =  -  1]“\ 
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Because  both  the  detector  noise  P„  and  the  clutter  background  temperature  field  Tg{0) 
are  random  variables,  so  is  the  detector  power  Pj  aud  must  be  characterized  statistically.  Fo 
the  vapor  cloud  image  enhancement /detection  algorithm,  only  the  first  and  second  statistics 
of  Pd  are  of  interest.  Denoting  ensemble  average  by  bar,  the  first-order  statistic,  mean  can  be 
given  either  by  £[Pdj(x,,  4)]  or  Pd^(x,,  4),  and  the  second  order  statistc,  covariance  matrix 
given  by 


Aprf  ,(x,-,4,X,-,40  =  E{[Pd^{Xi,tk)  -  Pij(x,-,t;t)][Pd^,(x.-,tt-)  -  Pd^,{x,^,tk')]}. 


In  order  to  evaluate  these  moments  we  assume  that  the  clutter  temperature  field  TgiO^tk) 
to  be  spatially  wide-sense  stationary,  i.e.,  Tb(^,  ft)  =  Tg  and 


Tg^,X0,e')  =  E{[Tg{6,tk)  -  Tg][Tg{e\tk.)  -  Tg]}. 


These  conditions  mean  that  the  background  fluctuations  are  uniform  over  the  image  field. 
Evaluating  the  mean  of  Pd  gives 


Pd{x,)  =  J  p,{e,tk)PSF{xiif  -  e)de  +  p„(x.)  (3) 

with 

PljJJT)  =  Ag^lgto  r{F^{X)[B,{Tc)  +  -  B,[Tc))]}  (4) 

J  0 

By  expanding  Bx{Tg{6,tk))  about  7g 

mjWM)  =  BxiTE)  +  +  0(<75.j 

where  is  the  constant  variance  of  the  temperature  background  field,  and  B"  is  the 
second  derivative  of  the  Planck  function  with  respective  T.  Numerical  evaluation  of  B'-f^  for 
Tg  =290°K  at  A  =  10pm  shows  that  B"/Bx  =  1.8  x  10“'*,  so  for  ctb  ^  lO^K  there  is  less 
than  one  percent  error  in  approximating 


BxiTgie.tk))  ^  BxiTg). 


(5) 


Since 


E[Ps,{6,ik)Pn,,{'^i',ik')]  =  0, 


PSF{x,if  -  e)}deue'^  +  An„,(^,4;^',4')  (6) 

with 

A,^^,  {0,  tk-,0',  h')  =  {( ApfJpeo)"  I  F,(A)F,-(  }  x 

By  expanding  Bx{TB{0,tk)  around  Tb,  i.e., 

Bx{Tb{0,  tk))\T^  ^TE+  B'x{TE){TB{e,  tk  -  TE) 
we  obtain  the  following  equalites: 

=  £{[5UT^)(rB(^,4)  -T¥)][(B;)(27)(rB(0',ifc.)  -^)]} 

where  B\{Tg)  is  the  first  derivative  of  the  Planck  function  evaluated  at  Tb-  If  we  denote 

£ £{irB(e,4) -li)l[(rB(«',4.) -is)!}. 

Equation  (7)  can  be  rewritten  as 

Bi(T;)AT.,,.,B'v(7S)  (8) 

which  is  a  factored  form  of  spectral  and  spatial  components. 

By  taking  advantage  of  equation  (8) 

^Sjj,{0,tk',d\tk')  ~  Gj(0,  4)ATg^B^^Gj(^',4-)  (9) 
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with 


G,(0,4)  =  AnUnto  J  F,{X)TAiX)B',{TB)e-»^^^^^’^^^dX. 

Finally,  the  signal  model  is  derived  as  follows. 

(Pd-£:{Pd}) 

pdf(Pj)  =  ^=ef  H  1  (10) 

where  the  detector  power  has  been  expressed  as  a  vector  having  components 

(Pd).jit  =  Pd,{x„tk) 

and  i,  1  <  i  <  labels  the  detector  plane  pixel,  j,  I  <  j  <  L,  labels  the  spectral  band,  and 
k,l  <  k  <  M,  labels  the  frame  time.  The  mean  and  covariance  of  are  given  by  equations 
(3)  and  (9)  respectively. 
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III.  Target  Model 


To  construct  a  target  model  appropriate  for  image  enhancement  of  vapor  clouds  against 
clutter  backgrounds  we  rewrite  equation  (2)  as 

T:^{0,tk)  =  Pa,  + 


where 

Pa,  =  AnClnto  J  R{X)B,{Tc)dX, 

and 

Pb,  =  ArQ.r€o  J  Fj{X)TA{X)ABxdX, 

with  ABx  =  Bx{Tb)  —  Bx{Tc),  and  a  vapor  component  defined  as 

‘  s  F,(\)T^(\)ABxdX 

The  above  equation  can  be  interpreted  as  a  spectral  average  over  the  jth  spectral  band 
of  the  transmission  loss  produced  by  the  path- integrated  concentration  CL{6,tk)  along  the 
line-of-sight  0  at  time  For  narrow  band  optical  filters,  and  ABx  are  approximately 
constant  over  the  support  of  the  bandpass  function  Fj,  giving 


J 


with  AAj  =  f  Fj{X)dX  the  effective  bandpass  width  of  the  jth  optical  filter. 
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IV.  Recursive  Detection  Algorithm  Developed  by  Warren 

The  main  result  in  Warren’s  work  is  to  present  a  recursive  detection  algorithm  to  process 
thermal  images  in  frequency  domain.  The  idea  is  to  model  the  background  as  a  first  order 
autoregressive  time  series  by  which  the  detection  of  vapor  clouds  can  be  done  recursively  in 
time  frames.  The  approach  is  to  use  the  Markov  property  provided  by  the  autoregressive 
model  to  decompose  a  test  statistic  into  two  parts,  a  test  statistic  obtained  from  the  preceed- 
ing  time  frame  and  observation  generated  at  the  present  time.  Because  of  Markov  property, 
the  past  information  only  depends  on  the  time  frame  immediately  before  the  current  time 
frame.  Therefore,  the  latest  test  statistic  already  provides  all  the  past  information.  By  tak¬ 
ing  of  this  advantage  Warren  derived  a  recursive  algorithm  in  time  for  real  time  processing. 
In  this  section,  Warren’s  algorithm  will  be  rederived.  However,  there  is  an  alternative  which 
has  a  more  general  aspect  than  does  Warren’s  approach,  that  is  Kalman  filter  approach 
which  will  be  investigated  in  detail  in  the  next  section. 

Image  Model 

The  image  model  used  in  Warren’s  work  is  described  by 


Ho  :  4(x)  =  B,{x)  +  Afc(x) 

versus  (11) 

H,  :  4(x)  =  nix)  +  Bkix)  +  Nk{x) 

where  the  background  is  modeled  by  a  first  order  autoregressive  time  series 

5,(x)  -B  =  YiGix-  x')[Bk-iix)  -  B]  +  e,(x),  (12) 

X' 

and  their  corresponding  correlation  matrices  are 

AB{x,x')kk>  =  E[[iBkix)  -  WBk'ix)  -B)]  (13) 
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(14) 


Ae(x,x')itfc'  =  £’[efc(x)eit'(x)] 

=  [ABitJk'  —  G0ABfcfc'0G](x,x')^;t*« 

Cn{yi-x')6kk'  =  E[{Nk{x)-N){Nkix)-N)] 

Tk{x)  =  A5(x-xr(^)) 

f;[4(x)|//o]  =  70  =  3  +  7^ 

E[h{x)\Hr]  =  7r  =  T,(x)  +  7o 

As  mentioned  in  Warren’s  work,  because  of  correlations  between  different  time  frames- 
the  image  model  described  above  is  not  directly  useful  for  developing  detectors  whose  test 
statistics  take  the  form  of  ratio  of  one  likelihood  function  to  another  likelihood  function.  In 
order  to  circumvent  the  dilemma,  Warren  Fourier  transferred  samples  in  spatial  domain  to 
frequency  domain  with  which  statitsical  and  computational  advantages  can  be  gained. 

Algorithms  Developed  in  Frequency  Domain 

afc(u)  =  5^[/fc(x)  -  7o]e-‘^“  ’' 

X 

h{u)  =  Y^[Bk{x) 

X 

n,(u)  = 

X 

tk{n)  =  =  Ae-2'»’'S(u) 

X 

Based  on  the  above  discrete  Fourier  transforms,  an  equivalent  test  hypothesis  problem 
to  that  described  by  (11)  is  given  as  follows. 

Hq:  a*,(u)  =  6fc(u)  +  nfc(u) 

versus  (15) 

Hi  :  ajt(u)  =  tfc(u)  +  6fc(u)  +  n/fc(u) 
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where  we  assume  £[a*(u)|//o]  =  0  and  £’[a*(u)|/fi]  =  <fc(u).  Under  mild  conditions,  the 
correlation  matrix  of  afc(u)  betwen  ajt/(u)  is  given  by 


A.(u,u')u.  =  f;|6lE'(u)6,.(u')|  +  £’[n?(u)n..(u')| 
where  H  is  a.  Hermitian  conjugation,  which  results  in 

Aa(u,u'K'  =  {^[6f(u)6fc,(u')]  +  f;[|nfc(u)n<5,,-}62(u  -  u')]  (16) 

Since  the  backgorund  is  assumed  to  be  a  first  order  autoregressive  model,  the  correspond¬ 
ing  discrete  Fourier  transforms  (DFT)  in  frequency  domain  is  given  by 

6,(u)  =  7(u)6,_i(u)  +  /?fc(u)  (17) 

where 

7(u)  =  5:G(x)e-‘“'"*  (18) 

X 

I3{u)  =  ^e(x)e-2'“’'  (19) 

X 

Let  $i,(u)  and  ^n(u)  be  corresponding  DFTs  of  A(,(x)  and  C„(x).  Then 

$6(u)  =  ^A6(x)c-2’^“’‘  (20) 

X 

$„(u)  =  5:C„(x)e-2-«*  (21) 

X 

with 

£[/?fc(u)]  =  0,  (22) 

E[l3k{u)l3k'{u')]  =  cTl{u)S^{u-u')Skk-  (23) 

4iu)  =  [1  -  l7(u)n$,(u).  (24) 

Combining  the  above  equations  yields,  for  k  >  k' 

Aa(u)u-  =  {[7(u)]*-‘'^>6(u)  -f  ^n{u)8kk'}Skk'{u).  (25) 
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As  mentioned  in  Warren’s  work,  under  mild  conditions  the  probability  density  function 
OL  the  corresponding  DFT  is  also  a  Gaussian  distribution  under  the  hypothesis  H,  and  given 
by 


p(a(M)|/f.)  = 


2  MM  _  _ 


7rA^n^|Aa(M)l 


k,k'=\  U 


where  we  define 


at|i(u)  =  £[afc(u)|/fi] 


at.|.(u)  =  E[ak'{u)\Hi] 

and  Aa(M)  is  the  autocovariance  matrix  of  the  random  vector  [at(u), a;t-i(u),  •  ■  •,ai(u)]. 
By  defining 

a(*)  =  afc(u)  =  [afc(u),Ofc_i(u),  •  •  •,ai(u)]^ 

a(fc+l)  =  afc+i(u)  =  [afc+i(u),afc(u)]^ 


we  obtain 


MM 


||a(A/) -a(M|i)||^a->(M)  =  21  ~  *(u)itfc'(afc'(u)  -  a;t'|.(u))-  (26) 

k,k'=l  U 

Taking  logorithm  of  ratio  of  p{a{M)\Hi)  to  p(a(M)|/fo)  yields  the  log  likelihood  ratio 
test  given  by 

-  log  (27) 

The  log  likelihood  ratio  test  Z,i?a(A/)(-^i  Xy)  obtained  from  the  above  equation  is  the 
desired  detector  to  be  used  for  thermal  image  detection.  Unfortunately,  the  DFT  of  the 
autocovariance  matrix  generated  by  &{k),  Aa(fc)  becomes  very  large  as  time  frames  k  are 
accumulated.  In  particular,  calculating  the  inverse  of  Aa(fc)  becomes  extremely  complicated. 
One  way  to  avoid  this  difficulty  is  to  compute  LR^(k){A,'x.j)  recursively  until  k  reaches  M. 
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In  what  follows,  we  follow  Warren’s  approach  to  derive  a  recursive  formula  for  updating 
the  log  likelihood  ratio  test  when  time  moves  along. 

Recursive  Formula 

First  of  all,  we  express  the  autocovariance  matrix  of  a(fc  +  l){u)  at  time  A:  +  1  in  terms 
of  that  of  a(/i:)(u)  at  time  k, 


where 


^a{k  +  1)  — 


Ao 

Rk  Aa(^-). 


(28) 


Mjc+l 


=  + 


In  order  to  invert  the  matrix  we  use  the  following  matrix  identities  in  matrix  algebra. 
Assume  that  the  matrix  E  has  the  following  form: 

__  [  A  B' 

[ C  D / 

Then  the  inverse  of  E  can  be  calculated  as  follows. 

—1  _  \  +  A-^D{B -CA-^D)-^CA~^  -A-^D(B-CA-^D)-^' 

-  [  _(5  _  CA-^D)-^CA-^  (B  -  CA-^D)-^ 

{A-DB-^C)-^  ~{A-  DB'^Cy^DB-^  1 

~  [  -B-^C{A-DB-^C)-^  B-^  +  B-^C{A-DB-^C)-^DB-^  \' 

Applying  the  above  matrix  identities  (29)  to  Aa(fc  +  1)  yields 


Aa"‘(A:  +  l)  = 


a;^  -Aj'Yf 

-Y,A,-‘  Aa-‘(A:)  +  Y*ArY" 


where 


Afc  =  An-i2j^Y* 
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'im 


^  Jt+i 


Now  if  we  define 


-  I7H  +  $n(l  +  ItH  -  !7p^nA;:'$n 
7"[1-$„A,-\$„A,-^Y"] 


&{k\i)  =  E[ai{k)\Hi\ 
a{k  +  iTO  =  E[a{k  +  1)\H,] 


and  substituting  equation  (30)  into  equation  (26)  yields 


i(fc  +  l)-a(fc  +  lli)ll^-.(;t^,)  =  l|a(fc) -a(fc|z)ll2-:,jt) 

+  llafc+i  ~ 


Using 


lA,(fc+l)l  =  lAfellA,(fc)l. 


p{a{k  +  l)\Hi)  =  p{ak+i\Hi,a{k))p{a{k)\H,) 


we  derive  the  following  conditional  probability  density  function  given  that  Hi,a{k). 


p{ak+i\H„a{k))  = 


p{a{k+l)\H,) 

piaik)\H,) 

;pvTi^exp{--||a,+, 


where 

a, +11*,  =  aiTTi7  +  Y"{a(fc)-iW}  (38) 

=  0^7717  +  7"{(1  -  ^nA;ii)(afc(u)  -  a(fc|t)} 

+$nAfcii[afc|fc_x,i]  -  a{k  +  l|i)  (39) 

Plugging  equation  (37)  into  (35)  results  in  a  desired  recursive  formula  for  log  likelihood 
ratio  test  L/?a(fc+i)(^,  xr)  in  terms  of  LRa(k){A,XT)- 
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(40) 


LRa(k+i){A,XT)  =  Z,i?a(fc)(^,Xx)  — -|lai+i|x  —  a*:+i|fc,i|li-* 

Using  equations  (38-39)  to  interpret  (15),  we  obtain 

ayfc+i|fc,o  =  Y^a(/[:) 

Ofc+i|*,i  =  ti+i -I- Y^(a(fc)  —  t(/:)). 

Substituting  equations  (41-42)  we  further  obtain 

LRa(k+i){A,XT)  =  LR^(k){A,XT)  -  ^||4-i-i  -  Yi[^t(/:)||^-i 

+[4-n  -Y^t(fc)]"[A,-^]K+,  -  Y"a(*)] 

Finally,  if  we  define 


=  Y"t(fc) 

=  7^[(1  —  ^n^k-l)^k  +  $nAj^ij4|fc_l] 

then  a  nice  recursive  form  can  be  derived  and  given  by 


LRa{k+l){A,XT)  =  LRa{k){A,XT)  —  ~ 

+lh+I  -  ^k+llk]^[^k^][Ok+l  -  Ok+ilk,o] 


where 


Ofc+l|/:,0  —  7^[(1  ~  +  ^n^fcil(afc|i-l,o)] 


with  initial  conditions 


LRa(o)(A,XT)  =  0,  <i|o  =  0,  ai|o,,  =  0 


(41) 

(42) 


(43) 


(44) 

(45) 


(46) 
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V.  Recursive  Detection  Algorithm  Using  Kalman  Filtering 

Approach 


The  idea  of  using  Kalman  filter  theory  is  obvious  because  of  recursion.  Unlike  Warren’s 
work,  this  approach  can  be  used  to  model  background  of  different  types.  Recall  that  the 
background  in  Warren’s  work  was  assumed  to  a  first  order  autoregressive  (AR)  model.  As  a 
result,  Warren  could  use  the  Markov  property  induced  by  the  AR  model  to  derive  a  recursive 
formula  for  detectors  described  by  a  sequential  likelihood  ratio  test  statistic.  In  what  follows, 
we  will  still  adopt  Warren’s  model,  instead,  consider  a  different  approach  to  derive  a  similar 
recursive  formula  for  detectors.  The  approach  to  be  presented  is  to  use  Kalman  filter  theory. 
The  major  advantage  of  using  a  Kalman  filter  over  Warren’s  approach  is  that  the  formula 
to  be  derived  can  be  extended  to  cover  more  general  models  to  describe  background. 

The  core  of  Kalman  filter  theory  is  to  introduce  a  new  process,  innovation  process  sug¬ 
gested  by  Kailath.  Instead  of  directly  dealing  with  the  observation  process,  the  innovation 
process  is  generated  by  collecting  and  updating  new  information  as  time  goes  along.  In  other 
words,  given  an  observation  process  it  is  not  necessary  to  store  aJl  information  available  up 
to  the  processing  time  because  some  information  will  be  useless  and  some  will  be  repeat¬ 
edly  stored  which  wastes  storage.  A  more  efficient  way  to  manage  information  is  to  store 
all  necessary  information  only  once  and  dump  unnecessary  or  unwanted  information.  The 
innovation  process  is  developed  based  on  this  need.  In  general  an  observation  process  can  be 
decomposed  into  two  processes,  predicted  process  and  unpredicted  process.  The  predicted 
process  contains  all  previous  information  required  for  processing  and  the  unpredicted  process 
presents  new  information  available  at  the  processing  time  but  not  contained  in  the  predicted 
process.  Such  unpredicted  process  resulting  from  the  observation  process  is  generally  referred 
to  as  an  innovation  process. 

In  Kalman  filter  theory  two  models  need  to  be  specified  which  are  a  State  Model 
described  by  a  state  or  process  equation  and  an  Observation  Model  described  by  a  mea¬ 
surement  equation.  In  order  to  apply  Kalman  filter  theory  we  interpret  the  image  model 
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used  in  Warren’s  work  as  follows. 

Let  the  background  6fc(u)  be  a  state  model  chracterized  by  the  state  equation  or  process 
equation  under  hypothesis  Hi  given  by 

6fc(u)  =  7(u)6fc_i(u)  +  y9fc(u)  (47) 

and  the  observation  model  ajt|,(u)  depicted  by  measurement  equation  given  by 

afc|.(u)  =  Sfc|,(u)  +  bkiu)  +  nk{u)  (48) 

where  Sfc|o(u)  =  0  for  Hq,  no  target  present  and  sjt|i(u)  =  <i(u)  for  Hi,  target  present  . 

Since  the  derivation  for  a  recursive  Kalman  filter  under  hypothesis  Hi  is  exactly  the  same 
as  hypothesis  Hq,  we  only  consider  the  case  for  Hq  to  simplify  notations. 

Because  there  are  two  models  involved  we  define  two  innovation  process,  the  unpredicted 
observation  process  afc(u)  derived  from  the  measurement  equation  and  the  predicted  state 
error  process  efc+i,fc(u)  derived  from  the  state  equation  with  their  associated  correlation 
matrices  given  by 


afc(u)  =  ajt(u) -ait|fc_i(u) 

«M-i(u)  =  h{u)  -  bk\k_i{u) 

♦„,,(u)  =  BK(u)a''(u)l  = 

X 

X 

where  the  notation  H  is  a,  Hermitian  tranfomation,  Aa,k{^)  and  A(,;t,/t_i(x)  are  correlation 
matrices  of  afc(x)  and  Cfc,fc_i(x)  obtained  in  the  spatial  domain  time  k,k  —  1  respectively. 

As  we  can  see  from  above,  the  innovation  process  Qfc(u)  is  the  new  information  available 
which  is  contained  in  the  process  ajt(u)  observed  at  time  k  but  not  in  afcn_i(u)  where  is  the 
predicted  process  obtained  from  the  past  information  up  to  time  k  —  1.  Similarly,  (u) 


22 


is  the  innovation  process  represents  the  new  information  provided  by  the  state  model  bk{u) 
observed  at  time  k  and  is  obtained  by  substracting  the  predicted  process  6^|X:_i(u)  from 
bk{u)  so  that  the  predicted  information  from  6it(u)  up  to  time  k  —  I  can  be  removed.  One 
of  most  important  features  that  innovation  processes  possess  is  that  they  are  white,  i.e., 
independent  processes.  The  property  of  independency  makes  problems  extremely  easy  to 
deal  with.  The  observation  of  such  independency  is  intuitive.  Since  an  innovation  process 
contains  unpredicted  new  information  obtained  at  different  time  frames,  the  information 
obtained  at  a  certain  time  frame  must  be  independent  of  other  time  frames  due  to  the 
nature  of  unpredictability.  The  relationship  between  these  two  innovation  processes  can  be 
demonstrated  by  the  following  equation. 

Q:fc(u)  =  6fc(u)  +  nfc(u)  -  Sfc|fc_i(u) 

=  c*,*:_i(u)  +  njt(u) 

and 

^>c.fc(u)  =  +  $„(u) 

=  +  $n(u) 

Suppose  that  we  fix  time  k  and  consider  an  estimate  of  6/(u)  at  time  I,  6/|jt(u)  based  on 
the  information  available  up  to  time  k.  As  we  mentioned  previously,  the  innovation  process 
Qj(u)  provides  new  information  at  time  frame  j.  It  is  obvious  that  i/|fc(u)  can  be  expressed 
in  terms  of  a  linear  combination  of  Q;j(u)s  from  j  =  I  to  k  . 

i,|,(u)  =  £A.,o,(u).  (49) 

i=i 

In  order  to  determine  the  coefficients  Dt  j,  we  use  the  orthogonality  principle  which  gives 
£:[e,,*(u)a"(u)]  =  ii;[(6,(u)  -  V(u))a«(u)]  =  0;  m  =  1, 2,  •  •  • ,  /:, 
and  results  in 

£I(6,(u)a«(u)|  =  f:|i,|.(u)a»(u)| 
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=  £[{EA.,a,(u))Q"(u)| 

Di^rn  can  be  therefore  solved  by 

A.m  =  £[6/(u)a"(u)]$-^(u). 

Plugging  the  solved  Dij  into  equation  (49)  yields 

V(u)  =  '^{E[bi{u)af{u)]^-'^j{u)}aj{u). 
j=i 

Now  if  we  let  /  =  /:  +  1, 

k+i\kiu)  =  ^{£;[6fc+i(u)af(u)]$;J(u)}Q^(u) 

3  =  1 

=  +  ^[ifc+i(u)a"(u)]$-^(u)Qfc(u) 

3  =  1 

=  ^2  E[{l{u)bk{u)  +  /3;t(u)}Qf  (u)]$-^(u)aj(u) 

3  =  1 

+E[{'r{u)bkiu)  +  /?fc(u)}af  (u)]$-\(u)afc(u) 

=  7(u){^  E[bk{u)af{u)]^2!ji^W} 

3=1 

+7(u){£;[6fc(u)Qf(u)]$-\(u)afc(u)} 

=  7(u)6fc|fc-i(u)  +  7(u){£;[6fc(u)af  (u)]4>-\(u)a^{u)} 

=  7(u)S;t|fc-i(u)  +  G'fc(u)Q)t(n) 

where  G*:(u)  is  called  the  Kalman  gain  given  by 

Gfc(u)  =  7(u){£:[6*(u)a"(u)]$-\(u)} 

=  -/{u){E[bk{u){bk{u)  -  6fc|fc_i(u)  +  ni(u))"]4>;)- (u)} 

=  7(u){ii;[6i(u)(e;t.fc_i(u)  +  nfc(u))"]$;;t(u)}- 
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Since  £^[i*|it-i(u)e^^_i(u)]  =  0,  we  can  add  it  to  the  above  equation  and  obtain 


(50) 

(51) 

(52) 


G,(u)  =  7(u){i:[(fe.(u)-6,|,_x(u))(c",.,(u))]$-Uu)} 

=  7(u){£:[£t,fc-i(u)e^fc_i(u)]$;jt(u)} 

=  7(u)^a,fc-i(u)^”i(u). 

As  shown  in  equation  (52),  the  formula  for  Gfc(u)  is  not  very  useful  because  calculating  the 
Kalman  gain  Gk  requires  to  compute  $£,jt,jt-i(u)  which  is  still  unknown.  In  order  to  overcome 
this  difficulty,  we  derive  a  recursive  formula  for  ^>e,fc,/t_i(u). 

Consider  the  predicted  state  error  at  time  frame  k  +  1,  ;t(u), 

tk+i,k{^)  =  bk+i{u)  -  bk+i\k{u) 

=  7(u)6fc(u)  +  ^fc(u)  -  7(u)6fc|fc_i(u)  -  Gfc(u)Q;t(u) 

=  7(u)[^fc(u)  -  bk\k-i{u)]  -  Gk{u)ak{u)  +  /3fc(u) 

=  7(u)[6fc(u)  -  6fc|fc_i(u)]  -  Gjt(u)[afc(u)  -  a;tjfc-i(u)]  +  /3k{u) 

=  7(u)[6fc(u)  -  bk\k-i{u)]  -  Gk{n)[{bk{u)  +  nk{\i))  -  6^|fc-i(u)]  +  ^^(u) 

=  7(u)[efc,<:_i(u)]  -  G k{u)ek,k-i{\i)  -  Gk{n)nk{u)  +  ^k{u) 

=  [7(u)  -  Gfc(u)]efc,fc_i(u)  -  G/t(u)nfc(u)  +  ^^^(u). 

This  implies  that 

$,,*+i.i(u)  =  £;[ejt+i.jt(u)e;^+i^^(u)] 

=  [7(u)  -  Gfc(u)]$,,fc,*_i(u)[7(u)  -  Gfc(u)]^ 

+£[/?, (u)/3f(u)]  +  G,(u)4>„(u)G"(u). 

where  E[0k{^)0k  i^)]  —  [1  ~  |7(u)n^6(u).  If  we  expand  the  above  equation,  we  obtain  the 
called  Riccati  difference  equation, 

^t,fc+l,*(u)  =  7(u)$£,it.fc(u)7"(u)  +  £'[/?fc(u)/3;t(u)^] 

=  7(u)$£,*.fc(u)7"(u)  +  [1  -  |7(u)n^>6(u) 
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where  we  denote  ;t(u)  by 

=  ^e,fc,)c-l(u)  -  [7(u)]-'Gfc(u)$,,,,,_,(u)  (53) 

In  order  to  make  the  derived  recursive  formulcis  work,  we  impose  the  following  initial 
conditions 

6i|o(u)  =  0 

$,.i,o(u)  =  £[6i(u)6"(u)]  =  $i,(u) 

After  deriving  the  desired  recursive  equations  for  our  image  model,  we  are  ready  to  apply 
them  to  the  problem  addressed  in  Warren’s  work. 

As  mentioned  previously,  the  importance  of  using  innovation  processes  is  the  indepen¬ 
dency.  In  what  follows  we  transform  original  processes  considered  in  the  image  model  to 
innovation  processes  and  reformulate  an  equivalent  hypothesis  testing  problem  in  terms  of 
these  innovation  process  Q:^(u)  and  As  a  result,  the  equivalent  hypothesis  testing 

problem  can  be  described  as  follows. 

Ho  :  afc(u)  =  ajt(u)  -  ak\k^i{u) 

versus  (54) 

Hi  :  Ofc(u)  =  4(u) +  ait(u) -afcn_i(u) 

where  ajt(u)  is  a  white  Gaussian  process.  The  reason  for  Qi(u)  being  a  white  Gaussian 
process  is  that  qa:(u)  is  independent  and  is  a  process  resulting  from  a  Gaussian  process  at(u) 
from  which  the  predicted  estimate  afc|*;_i(u)  is  subtracted  which  is  also  a  linear  combination 
of  Gaussian  processes. 

The  resulting  log  likelihood  ratio  test  for  this  hypothesis  testing  problem  is  given  by 


where 


LRa{k){A,XT)  =  log 


W(k)\Hoy 


aik)  =  [Qi(u),---,ajt(u)]. 
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(55) 


Since  Qj(u)s  are  independent,  the  log  likelihood  ratio  test  can  be  further  expressed  by 

LR«(k){A,XT)  =  log  1=1 - ,  °  A.l°g  [„/„  ;-„iH  J 

Y[j  =  l  jr=l 

=  5(1: lIHiTilll  +  o,(u|//„)4'-‘(u|%)<(u|«„) 

'I  jS 


||Qj(u|^fl)||^-i^(u|//i) 

=  + if/op 


where 

IK(u|//,)IIJ;.|„l„.l  =  a,(u|W,)4>;'(u|if,)af  (u|/?,)- 

The  last  two  equations  (equations  (57-58))  can  be  regarded  as  two  parts.  The  first  part  is 
the  likelihood  ratio  test  obtained  at  time  —  1  which  is  known  at  time  k  and  the  second  part 
consisting  of  two  terms  which  is  made  of  new  information  obtained  at  time  frame  k  under  two 
hypotheses.  The  former  represents  previous  and  predicted  information;  the  latter  updates 
new  information  as  time  elapses.  This  fact  is  also  demonstrated  in  equation  (40)  derived  by 
Warren  where  a/t+i|i  ~  afc+i|;;,i  and  a)t+i|o  —  n*:+i|*,o  represent  innovation  processes  generated 
by  the  observation  processes  a^+ijo  and  a*.+i|i  under  hypothesis  Hq  and  respectively.  The 
computation  of  the  innovation  process  and  DFTs  of  its  correlation  matrix  can  be  also 
recursively  calculated  by  equations  summaried  as  follows. 


Qfc(u)  =  afc(u)  -  ait|fc_i(u) 

e;c,/:-i(u)  =  5jfc(u)  —  6fc|jt_i(u) 

$a,Jt(u)  =  £;[Q;t(u)Qf(u)]  =^A<,,fc(x)e-^'*“ 

X 

♦a.^-,(u)  =  iJK, .,(u)e;(j.,(u))=  £  A, 
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^a,Jt(u)  =  +  $„(U) 

G'itlu)  =  7(u)<^,.it,fc_i(u)$~Jt(u) 

hk+i\k{u)  =  7(u)6fc|*;_i(u)  +  G;t(u)afc(u) 

^e,it+l.it(u)  =  7(u)$,,;t,fc(u)7"(u)  +  [1  -  |7(u)|^]$fc(u) 

^c,kA^)  =  ^£.fc,fc-l(u)  -  [7(u)]~^Gi(u)^>,,t,i_i(u) 

with  initial  conditions  given  by 

^i|o(u)  =  0;  LRa(o)  =  0  (59) 

^£.i.o(u)  =  £:[6i(u)6f  (u)]  =  $fc(u)  (60) 
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VI.  Recursive  Detection  Algorithms  for  Multiple  Spectral  Bands 

In  order  to  extend  Warren’s  algorithm  to  cover  multiple  spectral  bands,  we  consider  the 
two-spectral-band  case.  The  extension  to  multiple  bands  can  be  done  straightforwardly. 

Two  Spectral  Bands 

Let  X  and  y  be  two  sample  random  vectors  producing  spatial  images  and  a*:(u)  and  ak{v) 
are  corresponding  DFTs  respectively  where  we  use  u,  v  to  distinguish  two  different  spectral 
vectors.  In  general  the  pair  of  random  vectors  (x,  y)  is  correlated,  so  is  the  pair  (u.v).  Let 
ajt(u,  v)  be  the  joint  DFT  of  /(x,y)  obtained  based  on  the  spatial  image  jointly  generated 
by  (x,y)  in  spatial  domain.  Then 

a.(u,v)  =  i:i:i/,(x,y)) 

X  y 

where  the  notation  dot  denotes  the  inner  product  of  two  vectors. 

Similarly,  we  can  also  define 

6,(u,v)  = 

X  y 

n,(u,v)  =  !*•>'> 

X  y 

4(u,v)  =  = 

X  y 

Extension  of  Warren’s  Recursive  Algorithm 

Following  the  same  notations  in  Warren’s  work,  we  denote  the  covariance  matrix  of 
[4(x,y)]  at  time  frame  k  by  $a(x,  y)*  and  the  DFT  of  $a(x,  y)*  by  $a(u,v)*  and  related 

by 


^a(u,  V)fc 


X  y 


(61) 

(62) 
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Similarly  we  can  define 


4..(u,v)j  =  EEAUx.yle-"''"’''''*'” 

X  y 

X  y 

which  yield 

^a(u,v)jt  =  4>6(u,v)*:  +  $„(u, v)i  Under  Hq\  (63) 

^a(u,v);,  =  4(u, v)  +  4>i,(u, V);t  +  4>„(u, v)fc  Under  //j.  (64) 

Moreover,  the  background  and  noise  are  assume  to  be  statistically  wide-sense  homoge¬ 
neous  spatially  and  stationary  temporally.  So,  the  DFTs  $fc(u,v)i  and  ^>„(u,v);t  at  time  k 
can  be  actually  computed  by  $(u,v)i  and  r(u,v). 

If  we  denote  $(u,  v)i  by  $(,(u,  v)  and  [a*;(u,  v),  ajt_i(u,  v),  •  •  •  ,ai(u,  v)]  by  at(u,  v),  War¬ 
ren’s  recursive  equations  can  be  extended  to  cover  two  spectral  bands  as  follows. 


Ao(u,v) 

r(u,v) 

^A:(U,V) 

Aa(A:+  1) 
Afc(u,v) 


$b(u,v)  +  $„(u,v) 

7ii(u,v)  7i2(u,v) 

.72i(u,v)  722(u,v) 

$,(u,v)[r*(u,v),(r2)*(u,v),.--,(r*)-(u,v)] 

■  S6(u,v)  Dl{u,v) 

Dfc(u,v)  As,{k) 


Ao(u,v)  -  Dl{u,\)Yk{u,\) 


Y,(u,v) 
Aa  ^{k  +  1) 
Afc+i(u,v) 


Y;+i(u,v) 


Aa  ‘(^)^(u,v) 

Ai"*(u,v)  -Afc*(u,v)Yi'(u,v) 

_  -Yfc(u,v)A;*(u,v)  Aa~*(/:)(u,v)  +  Yfc(u,v)A;‘(u,v)Y;(u,v) 

$6(u,v)(l  -  l7(u,v)p)  -I-  $„(u,v)(l  +  |7(u,v)12) 

-l7(u,v)p^>„(u,v)A;'(u,v)$„(u,v) 

7’(u,v)[l  -  ^>„(u,v)A^‘(u,  v),^„(u,  v)A;'(u,  v)Yt(u,  v)] 
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It  should  be  noted  that  the  dimension  of  the  matrix  $(,(u,v)  is  2N  x  2N  whereas  that 
of  $6(u)  is  N  X  N . 

Extension  of  Recursive  Algorithm  Using  A  Kalman  Filter 

One  of  nicest  features  of  Kalman  filtering  approach  is  that  the  dimensionality  of  the  state 
and  observation  models  are  arbitrary  and  can  be  any  finite  dimensions  as  long  as  they  are 
appropriately  aligned.  This  property  makes  an  extension  of  the  results  for  a  single  spectral 
band  very  easy  and  straightforward  to  multiple  spectral  bands.  As  assumed  earlier,  let  (x,y) 
be  two  joint  random  vectors  which  generates  spatial  images  in  spatial  domain  and  let  (u,  v) 
be  the  corresponding  two  spectral  vectors  used  to  describe  their  DFTs.  The  results  for  a 
single  band  can  be  easily  extended  as  follows. 

The  desired  two-spectral  band  log  likelihood  ratio  test  can  be  derived  straightforwardly 
in  terms  of  DFTs  by  using  the  same  treatment  done  in  Section  V.  Namely, 


where 


=  ,65) 


a{k)  =  [Qi(u,v),---,afc(u,v)], 


and 


LR,^,^{A,Xt) 


(66) 


-a,(u,  v\H,  )$-;(u,  v|//i  )af  (u,  ) 

(68) 

^>a,t(u,  v|//i) 


(67) 


1 


]} 


-f-{||a,(u,v|//o)|l^-.,,^l^^,  -  |K(u,v|//,)||^-., (69) 
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where 


and  all  the  necessary  recursive  equations  are  summarized  as  follows. 


Qfc(u,v) 

a;b(u,v)  -  ak\k-i{u,v) 

£fc.*:_l(u,v) 

= 

6^(U,V)  -  6fc|*:_i(u,v) 

V) 

£K(u,v)af(u,v)]  H 

X  y 

X  y 

^a,*:(u,v) 

= 

^t,i,Jt-i(u,v)  +  ^>„(u,v) 

Ga:(u,v) 

= 

7(u,  (u,  v)$"\(u,  v) 

6fc+l|Jt(u,v) 

= 

7(u,v)6fc|fc_i(u,v)  -I-  Gfc(u,v)Q;fc(u,v) 

4>,,fc+l.fc(u,v) 

7(u,v)$e,)c,fc(u,v)7"(u,v)  -h  [1  -  l7(u,v)l^]$t,(u,  v) 

= 

^c.h.k-\{u,v)  -  [7(u,  v)]'^Gfc(u,  v)$,,jt,;t-l(u,  v) 

with  initial  conditions  given  by 

6i|o(u,v)  =  0;  LRo,(o){A,Xt)  =  ^ 

$,,i,o(u,v)  =  £'[6i(u,  v)6f  (u,  v)]  =  4>fc(u,v) 


Separable  Spectral  Correlation 

As  we  can  see  from  the  recursive  equations  derived  for  two-spectral  band  in  both  ap¬ 
proaches,  it  is  very  difficult  to  calculate  correlation  matrices  for  the  background  and  noise, 
particularly,  their  inverses  because  the  dimensionality  increases  by  4  and  correlations  between 
spatial  images  in  two  spectral  bands  must  be  taken  into  account.  One  way  to  reduce  compu¬ 
tational  complexity  is  to  cissume  that  all  the  power  spectra  obtained  from  different  spectral 
bands  are  separable.  In  other  words,  under  this  circumstance,  the  observation  process  is 
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spectral-wise  (not  sample-wise)  correlated.  Namely,  if  we  let  [ai(u,  v)]  =  [ai(u), ai(v)]  and 
only  correlations  between  sample  images  ai(u)  from  one  spectral  band  and  sample  images 
ai(v)  from  the  other  will  be  considered.  By  doing  so  the  power  spectrum  of  the  observation 
process  [ai(u),ai(v)],  $a(u,v)i  can  be  much  simplified  and  given  by 


^>a(u,v)* 


£’[afc(u)(afc(u))"]  E[ak{u)(ak{v))^] 

£[a,(v)(a*(u))"]  £[a,(v)(a,(v))"] 


(70) 


where 


jE;[afc(u)(a*:(u))^] 

£K(u)(a,(v))''] 

£;[a*(v)(afc(u))^] 

£:K(v)(a,(v))"] 


^^A,(x)A,(x')e-^'"-e‘2--' 

X  y 

EE  Aa(x)A6(y)e 

X  y 

y  X 

y  y' 


Therefore, 


X  y 

X  y 

If  we  denote  ^>i(u,  v)  by  $i,(u,  v)  and  [ak{\i),ak{v),ak-i{u),ak-i{v),  ■  ■  • ,  ai(u),ai(v)]  by 
aji(u,  v),  then 


Ao(u,v) 

r(u,v) 

Dkiu.'v) 

Aft  (A:  -H  1) 
Aa:(u,v) 


^>i,(u,  v)  +  $„(u,v) 

7(u)  0 

0  7(v)  _ 

$i(u,v)[r(u,v),(r2)*(u,v),-.-,(r'')-(u,v)] 
E(,(u,v)  D’k{w,v) 

Dkiu,v)  Aa(A:) 

Ao(u,v)  -^;;(u,v)Yit(u,v) 


Yfc(u,v)  =  Aa'*(fc)i2*(u,v) 
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At+i(u,v)  =  $6(u,v)(l  -  |7(u,v)|2)  +  4>„(u,v)(l  +  |7(u,v)p) 
-l7(u,v)p$„(u,v)A;'^(u,v)^>„(u,v) 

Yi+i(u,v)  =  7*(u,v)[l  -  $„(u,v)A;^^(u,v),$„(u,v)AtHu,  v)Y;(u,v)] 


Separable  Spectral  and  Markov  Spatial  Correlation 

Thus  far,  all  derivations  given  above  assume  that  DFTs  of  spatial  images  obtained  from 
each  band  are  spatially  correlated.  In  multiple-band  case  correlations  exist  not  only  between 
spatial  sample  images  but  also  between  time  frames.  In  the  section  of  separable  spectral 
correlation  we  considered  the  case  that  sample  images  are  spatially  correlated  in  each  band 
and  temporally  blockwise  correlated.  In  this  section  we  can  further  reduce  complexity  by 
assuming  that  the  spatial  correlation  has  Markov  property.  Since  the  processes  x  and  y 
considered  in  the  image  model  are  generally  Gaussian,  these  observation  processes  can  be 
further  described  by  Gaussian- Markov  processes.  One  of  most  important  properties  of  a 
Gaussian-Markov  process  is  that  its  covariance  matrix  can  be  characterized  by  powers  of  a 
constant  with  abosulte  value  less  than  1. 

More  precisely,  let  the  covariance  matrix  of  the  random  vector  x  be  A(x),  then  the  entry 
in  the  position  (7,/)  of  A(x)  can  be  expressed  by  for  some  constant  \p\  <  1.  Applying 
this  property  to  the  covariance  matrix  of  the  background  fifc(x),  AB(x)jt  yields 

Ab(x)a:  = 

where  describes  the  horizontal  spatial  correlation  between  and  and 

indicates  the  vertical  spatial  correlation  between  and 

Furthermore,  using  the  property  of  spectral  separability  we  can  derive  the  correlation 
matrix  of  two  sample  images  which  generate  power  spectra  in  two  different  bands  as  follows. 

=  (71) 
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where  and  P2icr2  are  horizontal  and  vertical  spatial  correlations  of  images  x  and  y 

respectively.  Substituting  equation  (71)  for  AB(x,y)jt  in  the  recursive  equations  derived  for 
separable  spectral  correlation  will  yield  a  set  of  similar  necessary  recursive  formulas. 
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VII.  Conclusion 


The  main  theme  in  this  report  is  to  present  an  alternative  to  develop  a  new  recursive  al¬ 
gorithm  for  thermal  image  detection  and  extend  Warren’s  and  new  algorithms  from  a  single 
spectral  band  to  multiple  spectral  bands.  The  idea  to  derive  the  new  algorithm  is  Kalman 
filter  theory.  This  approach  is  more  intuitive  than  Warren’s  formulation.  A  complete  math¬ 
ematical  derivation  is  given.  There  are  some  future  directions  needed  to  be  investigated. 
(1)  Adaptive  techniques  should  be  considered  to  improve  effectiveness  of  suppressing  back¬ 
ground  clutter.  (2)  In  practical  situations  the  probability  laws  governing  the  background 
clutter  are  generally  not  informed.  We  must  estimate  them  by  virtue  of  sample  images.  For 
instance,  for  Gaussian  processes  the  mean  and  variance  matrices  must  be  estimated  before 
applying  recursive  algorithms.  (3)  For  real  time  implementation,  computer  simulation  for 
results  generated  by  this  report  needs  to  be  done  for  synthetic  images.  (4)  Development 
of  systolic  architectures  for  implementing  thermal  image  detectors  for  parallel  processing  is 
needed  lo  speed  up  computational  rates.  Finally,  (5)  .An  unconventional  approach,  neural 
network  should  be  investigated  to  increase  the  capability  of  thermal  image  detectors  to  adapt 
the  various  environments. 
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